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DESCRIPTION 

METHOD AND APPARATUS FOR MATCHING COLOURS 



The present invention relates to colour sampling devices, and in 
5 particular to methods and apparatus for matching sampled colour data vt/ith 
databases containing colour data. 

There are many occasions in which it is desirable for a person to be 
able to accurately match colours of objects. This can be quite difficult to 
10 achieve by eye. particularly where the objects to be matched have different 
textures or materials, or where lighting levels are inconsistent. Often, the 
matching has to be achieved from memory, without simultaneous direct visual 
contact with the two items to be matched, which many people find difficult. 

For example, it is a common requirement when purchasing home 
IS furnishings (including furniture, carpets, curtains, wallpaper, paint and the like) 
to try to match the colours of those home furnishings with existing colour 
schemes in a room in which they will be placed. Typically, this can only be 
accurately achieved by obtaining from the retailer a colour sample (such as a 
swatch, fabric cutting or match pot of paint, for example) and taking this colour 
20 sample home, prior to deciding on the purchase. 

In another example, it is a common requirement when purchasing 
clothing for a person to find articles that match or complement existing items in 
their wardrobe, or that match the person’s “ideal colours”, as often specified by 
a style consultant. For example, many people make use of a personal colour 
25 bureau that generates a custom palette of colours suited to an individual’s hair, 
eye and / or skin colours. Searching for the appropriate clothing items can be 
time consuming, requiring visits to many clothing retailers in order to find 
appropriate items. 

Many colour sampling devices are known in the art. For example, US 
30 6,157,454 describes a colorimeter for measurement of the colour of an object. 

The colorimeter comprises a pen-shaped probe with a probe tip, which 
measures reflectance of the object at the wavelength of the three primary 
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colours to then determine a colour value by reference to a look-up table of 
stored reflectance ratios. 

US 6,043,893 and US 5,483,339 both describe portable reflectance 
spectrophotometers for determining levels of each spectral component of an 
5 object. US '339 also proposes an interface to a computer for transferring a set 
of colour standards to the spectrophotometer and for transferring 
measureme.nt data from the spectrophotometer. 

US 5,995,650 describes a portable system for measuring shape, 
contour, colour and other data relating to an object by rapid scanning of the 
10 object with a geometric light shape. 

US 2001/44801 describes a system for producing an electronic colour 
information data file for communication of colour data describing one or more 
colour samples to a receiver, such that the receiver can display the colour. In 
particular, the system may incorporate in the data file not only colorimetric 
15 data, but also specify colour exchange format, device dependent colour data, 
surface condition and graininess of the object and the like. 

It is an object of the present invention to provide a portable device for 
locating items having a predetermined colour or colours. 

20 It is a further object of the present invention to provide a portable device that is 
able to sample colours from the environment and then access a search engine 
for locating details of products or articles that meet colour matching 
requirements. 

It is a further object of the present invention to provide a portable device 
25 that is able to sample colours from the environment and then determine a 
quantitative degree of matching with a colour palette stored therein. 

According to one aspect, the present invention provides a method of 
colour matching comprising the steps of: 

sensing colour information representative of an article being sampled, 
30 with a portable user device having an optical sensor; 

generating a colour definition data file from said colour information; 
transmitting said colour definition data file to a remote database; 




wo 2004/018984 



PCT/IB2003/003479 



3 

searching the database for data items that match colour criteria 
indicated by the transmitted colour definition data; 

generating a list of said data items; and 

transmitting said list of data items to the user device, 

5 Optionally, the sensing step includes directing a digital camera at at 

least a portion of the article to form an image thereof and defining a target 
region of the image for which target region the colour information is to be 
sampled. In this case the method may further include the step of determining 
an average of the sensed colour information or a representative colour set, for 
10 use in generating the colour definition data file. 

Optionally, the sensing step further includes determining a temperature 
of the light illuminating the colour image. In this case, the step of generating a 
colour definition data file can also include incorporating temperature of the light 
illuminating the image that produced the colour definition data file. 

15 The method may also include the step of storing a plurality of said 

colour definition data files relating to different articles for later transmission to 
the remote database. 

The article being sampled may be, for example, any one of an article of 
clothing, an article of furniture, a colour sample chart or swatch, a fabric, a 
20 carpet, curtain material, wallpaper or paint. 

The method can further include the step of displaying, on the portable 
user device, the list of data items. 

Optionally, each data item includes data identifying an article available 
for purchase. Optionally, each data item may also include data identifying a 
25 location of the article available for purchase. 

The method may further include the step of transmitting an indication of 
location of the user device to the remote database. 

The method may further include the step of transmitting, with the colour 
definition data file, an indication of a class of articles to which the colour 
30 defined in the definition file is to be matched. 
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The method may further include the step of transmitting, with the colour 
definition data file, an indication of a category of article to which the colour 
defined in the definition file is to be matched. 

Optionally, the remote database is installed in a retail store, and the 
s step of generating a list of data items comprises generating a list of articles 
available for sale in the retail store that match colour criteria indicated by the 
transmitted colour definition data. 

According to another aspect, the present invention provides a method 
of colour matching comprising the steps of; 

10 sensing colour information representative of an article being sampled, 

with a portable user device having an optical sensor; 

generating a colour definition data file from said colour information; 
transmitting said colour definition data file to a remote database; 
receiving from the remote database a list of one or more data items 
IS each relating to an article that matches colour criteria indicated by the 
transmitted colour definition data; and 

providing as output to a user the one or more data items in the list on 
the portable user device. 

The method may further include the steps of: 

20 receiving product location information with each of the received data 

items; and 

providing as output said product location information on the portable 
user device. 

According to another aspect, the present invention provides a method 
2S of colour matching comprising the steps of: 

receiving a colour definition data file, including colour information 
representative of a sampled article, from a portable user device; 

searching a database for data items that match colour criteria indicated 
by the transmitted colour definition data; 

30 generating a list of one or more data items each relating to an article 

that matches colour criteria indicated by the received colour definition data file; 
and 
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transmitting said list of data items to the user device. 

The method may further include the step of transmitting, to the user 
device, product location information in respect of data items in the list. 

According to another aspect, the present invention provides a method 
5 of colour matching using a portable colour matching device, comprising the 
steps of: 

sensing colour information representative of the colour of an article 
being sampled with an optical sensor; 

generating a colour definition data file from said colour information; 

10 storing a plurality of colour definition data files relating to previously 

sampled objects; 

receiving a colour definition data file relating to a current sampled 
article, and searching colour definition data files in the memory to determine if 
any of the stored files match colour criteria indicated by the colour definition 
IS data for a current sample; and 

providing as output on the colour matching device an indication if any 
stored files match the colour criteria. 

According to another aspect, the present invention provides a portable 
colour sampling device comprising: an optical sensor for sensing colour 
20 information representative of the colour of an article being sampled; 

means for generating a colour definition data file from said colour 
information; 

a wireless transmitter for transmitting said colour definition data file to a 
remote database; and 

25 a wireless receiver for receiving, from said remote database, a list of 

data items that match colour criteria indicated by the transmitted colour 
definition data. 

The optical sensor may comprise a digital camera. 

In this case the camera may include a visual targeting device enabling 
30 the user to determine a portion of an image of an article for which the colour 
information will be generated. The sampling device may further include means 
for determining an average of the sensed colour information or a 
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representative colour a representative colour set, for incorporation into the 
colour definition data file. 

The optical sensor may further include means for determining the 
temperature of the light used to illuminate the colour image. In this case the 
5 means for determining a temperature of the light illuminating the image may 
include an illumination device. 

The device can further include means for reading a product barcode. 
The sampling device can further include means for storing a plurality of said 
colour definition data files for later transmission to a remote database. 

10 The sampling device can further include a display for displaying said list 

of data items. 

The sampling device can further include an audio output device for 
presenting said list of items to the user. 

The transmitter and receiver of the sampling device may comprise a 
15 mobile telephony device. 

The transmitter and receiver of the sampling device may comprise a 
Bluetooth device. 

The sampling device may further include means for transmitting, with 
the colour definition data file, an indication of current location of the sampling 
20 device. 

The sampling device may further include means for transmitting, with 
the colour definition data file, an indication of a class of articles to which the 
colour defined in the definition file should be matched. 

According to another aspect of the present invention there may be 
25 provided a personal digital assistant or mobile telephone incorporating the 
sampling device. 

According to another aspect, the present invention provides a colour 
matching server comprising: 

means for receiving, from a portable colour sampling device a colour 
30 definition data file indicating sensed colour information representative of the 
colour of an article; 
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a database of data items, each data item relating to an article and one 
or more colour properties of that article; 

a search engine for receiving the colour definition data file and locating, 
in the database, data items that match colour criteria indicated by the 
s transmitted colour definition data; 

means for generating a list of said data items; and 
means for transmitting said list of data items to the portable colour 
sampling device. 

The means for transmitting and the means for receiving may comprise a 
10 mobile telephony device. 

The means for transmitting and the means for receiving may comprise a 
Bluetooth device. 

Each data item may further include data identifying an indication of retail 
location of the respective article. 

IS Optionally, the data items relate to articles comprising any one or more 

of: an article of clothing, an article of furniture, a colour sample chart or swatch, 
a fabric, a carpet, curtain material, wallpaper or paint. 

The colour matching server can be installed in a retail store. 

According to another aspect, the present invention provides a portable 
20 colour sampling device comprising: 

an optical sensor for sensing colour information representative of the 
colour of an article being sampled; 

means for generating a colour definition data file from said colour 
information; 

25 a memory for storing a plurality of colour definition data files relating to 

previously sampled objects; 

a comparison engine for receiving a colour definition data file relating to 
a current sampled article, and for searching colour definition data files in the 
memory to determine any of the stored files which match colour criteria 
30 indicated by the colour definition data for a current sample; and 

means for indicating determined stored files that match the colour 
criteria. 
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The means for indicating may include means for indicating a 
quantitative degree of closeness of match to the colour definition data of the 
current sample. 

The means for indicating may comprise a visual display and / or an 
s audio output. 

Embodiments of the present invention will now be described by way of 
example and with reference to the accompanying drawing in which; 

Figure 1 shows a schematic block diagram of a colour sampling device 
10 and networked connection to a colour matching server according to the 
present invention. 

With reference to figure 1. a portable colour sampling device 10 
includes an optical sensor 1 1 adapted to sense colour information 
IS representative of the colour of an article being sampled. Preferably, the optical 
sensor 11 is a digital camera, although any form of colorimeter or 
spectrophotometer device could also be used. The colour sampling device 10 
further includes a suitable data processing device 12 which generates a colour 
definition data file 14 for each article sampled. 

20 The colour definition data file 14 incorporates all the information 

necessary and sufficient to define the colour of the article to a required degree 
of accuracy. Many different colour definition protocols are known in the art - 
many of these are discussed in US 2001/0044801 - which may be used in 
preferred embodiments of the present invention. A preferred colour definition 
25 protocol uses RGB colour values derived from the digital camera 11. The 
^ RGB protocol offers a convenient 24-bit number representation which is useful 
for electronic storage and transmission. 

In the preferred embodiment, where the optical sensor 11 is a digital 
camera, the sampling device 10 preferably also includes a viewfinder (not 
30 shown) for imaging the surface of the article in view. The viewfinder may 
incorporate a visual targeting device, such as a cross-hair or “box" in the 
viewfinder which indicates a portion of the imaged article for which colour 
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information will be generated for inclusion into the colour definition data file 14. 
The colour sampling area may include a predetermined number of pixels of the 
imaging device (eg. at least 100) in order to ensure a representative mix of 
colours and hues to form an averaged single sample that is properly 
5 representative of the article. For instance it may reduce a colour set to the 8 
most common colours. 

The processing device 12 may provide an averaging process for 
determining a suitable colour average from colour information received in 
respect of a portion of an imaged article. Thus, an image of an article may be 
10 captured having a complex array of colours from the portion, and RGB values 
may be extracted therefrom to produce a range of colours that represent the 
article. 

Colour quantisation methods known in the art can also be used to 
reduce the number of colours in the image by producing an optimised set of 
15 representative colours for inclusion into the colour definition data file. 

In another embodiment it may be desired to represent a sample set to a single 
colour. In some instances this could be matched to the name of a colour or the 
name of a product colour (eg. a brand-specific paint colour name). This colour 
may then be more easily used for database searching. 

20 The colour sampling device 10 may include a colour correction system 

for determining the conditions under which the colour data was collected. The 
processing device 12 may then correct the colour data according to a 
predefined colour correction standard common to all sampling devices. 
Alternatively, the processing device 12 may store data Identifying the 
25 conditions in respect of which correction should be made with the colour 
definition data file. In this way, correction can be performed remotely from the 
device 10 when colour matching operations are being performed. Thus, the 
sampling device effectively incorporates means for determining the 
temperature of the light illuminating the sampled article. 

30 In a simplest form, this means for determining temperature of the light 

may be an illumination device provided in the form of a flash unit 1 3, for which 
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the specific temperature is known, and this temperature may be incorporated 
into the stored colour definition data files. 

The colour sampling device 10 preferably also provides a display device 
16. This may be a simple, text only display device, or more preferably a 
s display having colour graphics capabilities. Where the colour sampling device 
10 has determined that there are several colours in the object, or portion of the 
object, being sampled, the display device 16 may be used to display a list or a 
colour palette of all colours in the sample. The user may then view these 
colours and decide which should be used to generate the colour definition data 
10 file 14. This may be important where the object being samples contains a mix 
of disparate colours (eg. a tweed jacket). The image processing device 12 
may determine and display the range of colours in the sample, and possibly 
also resolve the image to a selection of key colours. 

The colour sampling device 10 preferably includes a memory 18 
IS capable of storing a number of colour definition data files 19, 20 for future use 
or reference. These could, for example, correspond to an individual user’s 
“ideal colour palette” which can be stored by sampling each one of the 
specified colours from a printed colour palette. 

The colour sampling device 10 further includes a transmitter / receiver 
20 device 22 (hereinafter “transceiver”) suitable for the transmission of colour 
definition data files through an access point 23 to a remote database 30 over a 
communication channel 25, and for receiving data from the database 30. The 
transceiver 22 may be any suitable wireless transmission system. 

In preferred embodiments, the colour sampling device is integrated into 
25 a mobile telephone handset, a personal digital assistant (PDA) or other mobile 
computing device. 

In one arrangement, a short range communication channel 25 may be 
used, and the transceiver may be a Bluetooth device or the like that 
communicates with a local server / database 30. 

30 In another arrangement, a longer range mobile telephony transceiver is 

used over a GSM or GPRS communications channel 26, for example. In this 
arrangement, the colour sampling device 10 communicates with a network 
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gateway device 35 via telephony cell transceiver 32, which fonvards 
communications to and from one or more servers 40, 41 over a suitable 
network 36. The network 36 may be the internet or a suitable wide area 
network (WAN) or local area network (LAN). 

5 Each one of the networked servers 40, 41 may provide access to one or 

more databases 42, 43, 44. 

Each of the databases 30, 42 ... 44 stores information relating to a 
plurality of data items each having associated colour definition data for 
matching against colour criteria derived from or contained in colour definition 
10 data files 14 transmitted from the colour sampling device 10. Each of the 
plurality of data items preferably relates to an object or article of merchandise 
available from an associated retail outlet. These objects may be any one of an 
article of clothing, an article of furniture, a carpet, curtain material, or paint, or 
any other object having an associated colour. 

IS The database preferably includes, associated with each data item, an 

indication of the retailer’s identity, the store location, and possibly also the 
location of the merchandise within the store. This may be effected by storing a 
product code with each data item which can be cross-referenced with a 
retailer’s database. Thus, it will be understood that the databases 30, 42 ... 44 
20 may in fact be distributed databases. 

A typical mode of use of the system of figure 1 will now be described. 
A user of the colour sampling device 10 may point the device at an object 
whose colour is to be matched with another object, and initiate a colour 
capture process by the optical sensor 1 1 and data processor 12. 

25 For example, the user may capture the colours of walls in his or her home, 
existing furniture or clothing, carpets, curtains and the like, or each of the 
colours on his or her personal colour palette. Each of these colours is 
captured and stored in the memory 18 as a colour definition data file 19, 20, 
preferably together with an associated memory tag or label identifying the 
30 source of the colour. 

Preferably, the user is also able to input further data for association with 
the colour definition data file. This further data may identify a category of 
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article or class of articles to which the data relates, and / or a category of 
article for which a colour match is desired. For example, the user may store 
colour definition data file 19 with a memory tag indicating that the colour 
relates to a skirt already owned by the user. The user may also add data 
5 relating to article matching criteria, for example, defining that the user seeks a 
jacket in a matching colour. 

The user may then initiate a transmission of one or more colour 
definition data files, together with the article matching criteria, to the database 
30. Using an appropriate search engine, the database provides, in return, a 
10 list of articles that have the requisite colour, and details of the location where 
they may be found. 

The location data may include a retailer ID, a location in a retail store, or 
a product code for furnishing to a shop assistant, or a web site address and 
product code for the purposes of on-line shopping. 

IS The data returned from the database 30 may be displayed on the 

display device 16. According to the bandwidth of the communication channel 
and complexity of the display, the returned data may be a simple text message 
directing the user to a specified shop, together with a suitable product code, or 
may provide a graphical representation of the matched articles available, 
20 together with retailer address and a map or other location finder. 

Alternatively, the database may supply to the user’s colour sampling 
device 10 a synthesised voice message providing the necessary information. 
This is particularly useful where the colour sampling device is integrated into a 
mobile telephone handset. 

25 In another aspect, the colour matching device could be used during a 

shopping trip to enter the article matching criteria. For example, the user may 
find a pair of trousers in the desired style, but fail to find the colour being 
sought. The colour definition data file 19 already stored in the device 10 may 
then be transmitted to the database 30 together with article matching criteria 
30 derived from the (wrong coloured) article in view. This may be achieved by 
providing a category of article, such as by way of a product barcode. 
Preferably, the product barcode could be obtained by way of a barcode 




wo 2004/018984 



PCT/B82003/003479 



13 

reading facility in the colour sampling device 10. The product barcode will 
therefore identify the style required, and the colour definition data will provide 
the colour required. It will be recognised that this product barcode reader may 
be the same optical sensor 1 1 as used in the colour sampling, 
s In another example of use, the scope of the database search may be 

automatically restricted to a given retailer or department within a retailer by 
providing a geographical indication of the location of the user. The geographic 
location of the user’s colour sampling device could be provided in a number of 
ways. 

10 For example, the colour sampling device 10 may be programmed by the 

user to add data indicating the town or city in which they are shopping, or a 
postcode region. The device 10 may be provided with an automatic location 
indicator such as by a GPS receiver. 

Alternatively, location may be implied through the communications 
15 channel in use. Where a short range (eg. Bluetooth) communications channel 
25 is being used, a retail store may provide a number of Bluetooth receivers in 
each department throughout the store. The colour definition data file received 
from the sampling device 10 may then effectively include an implied 
geographical specification for the scope of the product search, and thereby 
20 limit the list of data items that match colour criteria indicated by the transmitted 
colour definition data returned to the sampling device 10. 

In an implementation using a mobile telephony communications channel 
26, a geographical extent of search may be implied from identification of the 
network cell 32 transceiver that received the transmission. The database 30, 
25 42 ... 44 may then be able to restrict the list of data items that match colour 

criteria indicated by the transmitted colour definition data to those within a 
predetermined radius of the location of the user. 

In another embodiment, the colour sampling device may be used in a 
different manner. As described before, the colour sampling device 10 includes 
30 a memory 18 for storing a number of colour definition data files 19, 20 relating 
to articles sampled by the device. These files may include a user’s ideal 
colour palette. In use, a shopper when viewing clothing articles in a store may 
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use the colour sampling device 10 to simply verify a colour of a clothing article 
against one or more stored colour definition files within the device. 

Where a sampled colour matches one of the stored colour definition 
data files, the device may display the match, or the nearness of match on the 
s display 16. This assists the user in co-ordinating colours and provides an 
electronic mechanism for approving a match. The device may include a 
process for determining an index of merit indicating a closeness of match, or a 
degree of complement between, a sampled colour and each of a set of stored 
colour definition data files. 

10 The colour sampling device 10 may be adapted to provide a name to 

each sampled colour, which name can be displayed or voice synthesised, to 
be of assistance to colour blind, blind or partially sighted persons. 

Other embodiments are intentionally within the scope of the 
accompanying claims. 
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